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BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 


IMAGES ARE BEST AVAILABLE COPY. 

As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailbox. 


CM 

< 

CO 
CO 

s 


(19) 


J 



(12) 


(43) Date of publication: 

22.07.1998 Bulletin 1998/30 


Europiisches Patentamt 
European Patent Office 
Office europten des brevets (1 1) EP 0 854 633 A2 

EUROPEAN PATENT APPLICATION 

(51) iniCl. 6 : H04N1/32. 


(21) Application number: 98100636.4 

(22) Date of filing: 15.01.1998 


(84) Designated Contracting States: 

AT BE CH DECK ES R FR GB GR IE IT LI LU MC 
NL PTSE 

Designated Extension States: 
ALLTLVMKROSI 

(30) Priority: 17.01.1997 JP 5941/97 
17JB.1997JP 31545/97 

(71) Applicant: NEC CORPORATION 
Tokyo (JP) 


(72) Inventors: 

• tshlno, Toshlyuki 
Minato-ku, Tokyo (JP) 

* Sato, Shlnobu 
MInato-ku, Tokyo (JP) 

(74) Representative: 

Pfitzold, Herbert, Dt-lng. 
Steubstrasse 10 
82166 Grflfelflng (DE) 


(54) Image data Illegal use prevention system 

(57) An image data illegal use prevention system 
includes an image data fetching unit (6) for fetching dig- 
ital image data in which electronic watermark data may 
be embedded, and an electronic watermark data detec- 
tion unit (8) for detecting electronic watermark data from 
the image data fetched by the image data fetching unit 
(6). If electronic watermark data are detected by the 
electronic watermark data detection unit (8). then an 
image data recording utit (7) does not record the image 
data fetched by the image data fetching unit (6) onto a 
recording medium (9), thereby preventing Blegal dupli- 
cation- The electronic watermark data are calculated, 
for example, in accordance with an expression deter- 
mined in advance for frequency corrponents of discrete 
cosine transformed digital image data. 
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Description 

This invention relates to digital image processing, 
and more particularly to a system tor preventing illegal 
use of digital image data. 

2 Description of the Preferred Embodiment 

In recent years, illegal duplication of a digital image 
has become a problem. 

In order to prevent illegal duplication, a system has 
been proposed wherein digital image data are ciphered 
such that only a reproduction system having a legal 
decipherment key can reproduce the ciphered digital 
image data. However, once the cipher is deciphered, 
later duplication cannot be prevented. 

Thus, a system wherein a unique identification 
code is recorded on a recording medium to indicate per- 
mission or inhibition of duplication (refer to Japanese 
Patent taid-Open Application No. Hotel 8-69419). 
another system wherein decoders for subscription tele- 
vision broadcasting have different identification codes 
from one another recorded therein such Mat only those 
decoders which have contracted identification codes 
can effect correct deooding (refer to Japanese Patent 
Laid-Open Application No. Heisei 5-260468) and so 
forth have been proposed. 

Further, in order to prevent illegal use and duplica- 
tion of a digital image, also a method has been pro- 
posed wherein special information, that is. electronic 
watermark data, is embedded into the digital image 
itself As such electronic watermark data for a digital 
image as deserted above, two kinds of electronic 
watermark data of visible electronic watermark data and 
invisible electronic watermark data are available. 

The visible electronic watermark date are used 
6uch that a special character or symbol or the like is 
combined with an image so that tt may be visually rec- 
ognized. While the visUe electronic watermark data 
deteriorate the picture quality, they have on effect of vis- 
ually appealing to a user of a digital image for preven- 
tion of illegal use of the digital image. 

An example of embedding of vtstole electronic 
watermark data is disclosed in Japanese Patent Laid- 
Open Application No. Heisei 8-241403. According to the 
method disclosed In the document just mentioned, 
when visible electronic watermark data are confined 
with an original image, oriy the brightness corrponents 
of those pixels which correspond to opaque ones of the 
electronic watermark data are varied whie color com- 
ponents of the pixels are nor varied. In tfis instance the 
scaling factor by which the brightness components of 
Pixels are varied is determined based on color oppo- 
nents, random numbers, values of pixels of the elec- 
tronic watermark data and so forth. 

On the other hand, the invisible electronic water- 
mark data are electronic watermark data embedded in 
an image so that the picture quality may not be deterio- 


rated. Since the invisible electronic watermark data little 
deteriorate the picture quality, they are characterized in 
that they cannot be recognized visually. 

However, if special information which allows idenb- 
5 fication of an author is embedded as the electronic 
watermark data, then even after illegal duplication is 
performed, the author can be specified by detecting the 
electronic watermark data. On the other hand, if dupli- 
cation inhibition information is embedded, then, for 
10 example, when a reproduction apparatus detects the 
duplication inhfcition information, it is possible to notify 
the user that duplication of the data is inhibited or to 
render a duplication prevention mechanism in the repro- 
duction apparatus operative to limit duplication of the 
*s data by a video tape recorder (VTR) or the like. 

One of available methods of embedding invisible 
electronic watermark data into a digital image is to 
embed special information as electronic watermark 
data into a portion of pixel data such as the LSB (least 
so significant bit) which has a conparatively little influence 
on the picture quality. In other words, this method can 
be regarded as a method which inserts electronic 
watermark data into a waveform with respect to time of 
an image signal. However, where this method is 
2s applied, electronic watermark data can be removed 
readily from an image. For example, if a low-pass filter is 
used, then information of the LSB of a pixel is lost. Fur- 
ther, electronic watermark data are lost also by image 
compression processing since the image compression 
so processing reduces the data amount by removing infor- 
mation at such a portion which has a comparatively little 
influence on the picture quality as mentioned above. 
Consequently, the method described above is dtsad* 
vantageous in that K is difficult to re-detect the electronic 
35 watermark data. 

7hu6. another method has been proposed wherein 
an image is frequency converted and electronic water- 
mark data are embedded into a resulting frequency 
Spectrum (Nikkei Electronics. AprU 22, 1996. No. 660, 
40 P-W). In this method, since electronic watermark data 
are embedded into frequency components, the elec- 
tronic watermark data are not lost even by image 
processing such as compression processing or filtering. 
Further, random numbers which exhibit a normal distri- 
45 bution are adapted as the electronic watermark data in 
order to prevent interference between electronic water- 
mark data and make it difficult to destroy electronic 
watermark data without having a significant influence on 
the entire image. 
so In a method of embedding electronic watermark 
data, an original image D is divided into blocks of 8 pix- 
els x 8 pixels, and electronic watermark data are 
embedded regarding each block as a processing unit. 
Abo extraction processing of the electronic watermark 
66 data is performed in units of a block. 

In electronic watermark data embedding process- 
ing, data are first set successively as f (1 ), f(2) f(n) in 

the ascending order of the frequency component of an 
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AC component in a frequency region after discrete 
cosine transform (OCT) in MPEG (Moving Picture 
Experts Group) coding processing is completed, and 

electronic watermark data w(1), w(2) 2(n) are 

selected from within a normal distribution whose aver- 5 
age is 0 and whose dispersion is 1, and then 


F(0-f(l)^a-avg(f(i))-w(i) 

is calculated for the individual values of i, where a is a 10 
scaling factor, and avg(f (i)) is a partial average which is 
an average of absolute values of three neighboring 
points to the point f(l). Then, succeeding processing of 
MPEG coding processing is performed replacing f(i) 
with F(i). f5 

Detection of electronic watermark data is per- 
formed In accordance with a method described below. 
In the detection method, an original image is not 
required, but only it is required that electronic water- 
mark data candttates w(Q (where I - 1. 2. ... ( n) be so 
known. 

In a frequency region of each block after dequarti- 
zation of MPEG decompression processing is com- 
pleted, data are represented as F(2), F(2) F(n) in the 

ascending order of the frequency component. Average ss 
values of absolute values of three neighboring points to 
each point F(i) are represented as partial averages 
avg(F(i)) f and electronic watermark data W(i) are calcu- 
lated in accordance with 

30 

W(i)«F(i)fevg(F(i)). 

Further, sum totals WF(i) of W(i) tor one image are cal- 
culated for the Individual i. 

Thereafter, making use of an inner product of vec» as 
tors, a statistical similarity between the electronic water- 
mark data w(0 and the sum totals WF(i) is calculated in 
accordance with 

C-WF*w/(WFD*WD) 40 

where W . <WF(1), WF(2) WF(n)). w * (w(1). w(2), 

. .. w(n)) ( WFD - absolute value of the vector WF. and 
wO - absolute value of the vector w. When the statistical 
similarity C has a value higher than a particular value ft 4$ 
is discriminated that the electronic watermark data are 
embedded. 

However, where the method descnbed above is 
employed, if image data are regarded as a mere single 
block of digital data on a personal computer, they can be so 
duplicated by a desired number of times using a copy 
command of operation system software of the Windows. 
MS-DOS {both trade marks of Microsoft) or the like. 

Further, with a system which handles a digital 
image such as a digital video recorder. a copyrno ss 
machine or a facsimile, since a copy of data can be pro- 
duced simply, It itself cannot be prevented that digital 
image data including electronic watermark data are 


duplicated as they are. 

It is an object of the present invention to provide an 
image data illegal use prevention system which can pre- 
vent illegal use of digital image data without deteriora- 
tion of the picture quality and allows, even if digital 
image data are duplicated, identification of the owner- 
ship from the duplicate. 

In order to attain the object described above, 
according to an aspect of the present invention, there is 
provided an image data illegal use prevention system, 
comprising image data fetching means tor fetching dig- 
ital Image data in which electronic watermark data may 
be embedded, electronic watermark data detection 
means tor detecting electronic watermark data from the 
image data fetched by the image data fetching means, 
and transfer inhibition mean6 tor inhibiting, it electronic 
watermark data are detected by the electronic water- 
mark data detection means, transfer of the image data 
fetched by the image data fetching means to a transfer 
destination. 

According to another aspect of the present inven- 
tion, there is provided an image data illegal use preven- 
tion system, comprising image data fetching means for 
fetching digital image data in which electronic water* 
mark data may be embedded, electronic watermark 
data detection means tor detecting electronic water- 
mark data from the image data fetched by the image 
data fetching means, and transfer means tor transfer- 
ring, if electronic water mark data are detected by the 
electronic watermark data detection means, data differ- 
ent from the image data fetched by the image data 
fetching means to a transfer destination. Preferably, the 
different data are data obtained by superposing data 
obtained by multiplying the electronic watermark data 
by a constant on the image data fetched by the image 
data fetching means. \ 
According to a further aspect of the present inven- ■ 
tion, there is provided an image data illegal use preven- 
tion system, comprising image data fetching means for 
fetching digital image data in which electronic water- 
mark data may be embedded, electronic watermark 
data detection means for detecting the electronic water- 
mark data from the image data fetched by the image 
data fetching means, and transfer inhibition means for 
discriminating whether the detected electronic water- 
mark data indicate transfer permission or inhibition and 
inhibiting, when the detected electronic water mark data 
indicate transfer inhibition, a transferring operation of 
the fetched image data to a transfer destination. Prefer- 
ably, the transfer inhibition means discriminates, when 
the detected electronic watermark data include a value 
representing that the transfer permission time number is 
zero, that the detected electronic watermark data are 
electronic watermark data indicating transfer inhibition. 

Accordino to a still further aspect of the present 
invention, there te provided an image data illegal use 
Inhfeition system, comprising image data fetching 
means for fetching digital image data in which electronic 
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watermark data including a value indicating that the 
transfer permission time number is m may be embed- 
ded, watermark data embedding means tor embedding, 
into the fetched image data, new electronic watermark 
data which includes a value indicating that the transfer 
permission time number ie smaller by one than the pre* 
ceding value of m, and transfer means tor transferring 
the image data in which the new electronic watermark 
data are embedded to a transfer destination. 

In the image data llegal use inhibition systems, the 
electronic watermark data may be calculated in accord- 
ance with a predetermined expression using frequency 
components of the d gital Image data obttf ned by dis- 
crete cosine transform. Otherwise, any of the image 
data illegal use inNbrtion system may be constructed 
such that the image data fetching means fetches digital 
image data from a recording medium on which the dig- 
ital image data are recorded, and the transfer destina- 
tion is a recording medium different from the recording 
medium on which the digital image data are recorded. 

It is to be noted that, in the present ^edRcatton, 
the word transfer Includes transmission of digital 
image data from a source by or in which the digital 
image data are produced or stored to another element 
storage of such digital Image data into or onto another 
medium, duplication of digital image data from a record- 
ing medium in which the digital Image data are recorded 
to another recording medium, duplication of a fie by a 
computer and so forth and should be interpreted widely 
as any operation which makes digital image data in 
such a form as allows use of the digital image data. 

With the image data illegal use prevention systems 
described above, dedication of (mage data can be pre* 
vented without deterioration of the picture quality using 
an electronic watermark technique. Consequently, the 
image data illegal use prevention systems can be 
applied to various image processing systems. 

Further, illegal copying can be prevented without 
any limitation to a medium of copying source data and 
to a medium of a copying destination, and even if data 
are copied illegally, ff copyright data are embedded as 
watermark data in the data, then a person who has the 
ownership of the image data can be identified by inves- 
tigating the watermark data and a person who has per- 
formed illegal duplication can be specified. 

The above and other objects, features and advan- 
tages of the present invention will become apparent 
from the following description and the appended claims, 
taken in conjunction with the accompanying drawings in 
which like parts or elements are denoted by like refer- 
ence characters 


to 
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FIG. 3 is a block diagram showing an exemplary 
construction of a watermark data detection unit 
shown in FIG. i ; 

FIG. 4 is a block diagram of a digital video system 
to which the image data illegal use prevention sys- 
tem of FIG. 1 is applied; 

FIG. 5 is a block diagram of a digital copying system 
to which the image data illegal use prevention sys- 
tem of FIG. 1 is applied; 

FIG. 6 is a block diagram of a form of an image pro- 
duction and recording apparatus shown in FIG. 1 
where it is formed as a printer system; 
FIG. 7 is a block diagram of a form of an image 
duplication apparatus shown in FIG. 1 where it is 
termed as a facsimile system; 
FIG. 8 is a block diagram of another form of the 
image duplication apparatus shown in FIG. 1 where 
H is formed as a capture board system; 
FIG. 9 is a block diagram of a data transfer system 
to which an image data illegal use prevention sys- 
tem according to the present invention is applied; 
FIG. 10 is a flow chart illustrating operation of the 
data transfer system of FIG, 9; and 
FIG. 11 is a block diagram showing an exemplary 
construction of a watermark data detection/embed- 
ding unit shown in FIG. 9. 


FIG. 1 is a block diagram showing a basic construc- 
tion of an image data illegal use prevention system 
according to the present invention; 
FIG. 2 is a block diagram showing an exemplary 
construction of a watermark data embedding unit 
shown in FIG. i; 


FIG. 1 shows a basic construction of an image data 
illegal use prevention system to which the present 
invention is applied. The image data illegal use preven- 
tion 6ystem includes two principal components of an 
image production and recording apparatus 100 and an 
image duplication apparatus 101. The image production 
and recording apparatus 100 is composed of an image 
w data production unit 1. a watermark data embedding 
unit 2, a watermark data table 3 and an image recording 
unit 4. Meanwhle. the image duplication apparatus 101 
is composed of an image data fetching unit 5, an image 
data recording unit 7 and a watermark data detection 
*0 unit 6. 

In the image production and recording apparatus 
100, digital image data produced by the image data pro- 
duction unit 1 are sent to the watermark data embed- 
ding unit 2. The watermark data embedding unit 2 
48 inserts electronic watermark data of the watermark data 
table 3 into the (Sgital image data in such a manner as 
hereinafter described. The image data recording unit 4 
records the digital image data, in which the electronic 
watermark data are embedded, onto a recording 
so medium 5. 

In the image duplication apparatus 101, the image 
data fetching unit 6 fetches the digital image data 
recorded on the recording medium 5. The watermark 
data detection unit 8 detects the electronic watermark 
8$ data in the digital image data fetched by the imago data 
fetching unit 6 in such a manner as hereinafter 
described. The image data recording unit 7 records, if 
the image data fetching unit 6 does not detect electronic 
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watermark data, the digital image data onto another 
recording medium 9 to produce a duplicate, but does 
not perform, if electronic watermark data are detected, 
recording of, the digital image data onto the recording 
medium 9. 

FIG. 2 shows an exemplary construction of the 
watermark data embedding unit 2. Digital image data 
from the image data production unit 1 of FIG. 1, that is. 
discrete cosine transformed MPEG image data, are 
inputted to a partial average calculation section t n and 
an adder 1 14. The digital image data are represented 
as f(i) (i - 1 , 2, n) for the convenience of description. 

The partial average calculation section ill calcu- 
lates partial averages described hereinabove in accord- 
ance with arg(f(i)) • (|f(i-i)| ♦ ff(i)| «. |fr>i)|)/3 and 
supplies a result of the calculation to one of input termi- 
nals of a multiplier 1 12. 

To the other input terminal of the multiplier 112, 
electronic watermark data w(i) are supplied from the 
watermark data table 3. An output of the multiplier 1 12 
is multiplied by a scaling factor a by a multiplier 1 13, and 
a result of the multiplication is added to the digital image 
data by the adder 1 14. A result of the addition, that is, 
image data (f(i) + a * arg(f(I)) • w(i)) in which the elec- 
tronic watermark data are embedded, are obtained from 
the adder 1 14 and supplied to the image data recording 
unit 4 of FIG. 1. 

FIG. 3 shows an example of a construction of the 
watermark data detection unit 8. Data F(i) fetched by 
the image data fetching unit 6 of FIG. 1 are supplied to 
a partial average calculation section 115 and a divider 
1 16. The partial average calculation section 1 15 calcu- 
lates partial averages evg(F(i)) mentioned hereinabove. 
This calculation is performed, for example, in accord- 
ance with avgtFOJ-dFO-IUIFroi + IF^DD/a. The 
divider 1 16 performs calculation of W(i) » F(i)/avg(F(0) . 

Then, an adder 117 calculates, for the individual 
values of i, sum totals WF(i) of the thus calculated val- 
ues W(i) for one image, Then, the sum totals WF(i) are 
supplied to an inner product calculation section 1 18. by 
which inner products thereof with electronic watermark 
data w(i) of an object of detection are calculated. The 
calculation of the inner product calculation section 1 18 
is represented in the following manner. 


C « WF * w/(WF0 • wD) 

where WF Is a vector whose elements are WF(1) 

WF < 2 > WF (">. w Is a vector whose elements are 

"(1). w(2), .... w(n), WFD is an absolute value of the 
vector WF. and wD is an absolute value of the vector w. 

The inner product calculation section, J J 8.; calcu- 
lates inner products C for all of possible ones of elec- 
tronic watermark data and supplies the inner products C 
to a similarity discrimination section 119. 

The similarity discrimination section 119 detects 
those electronic watermark data which maximize the 
inner products C, and sends out a result of the detection 


to the image data recording unit 7 of FIG. 1 . 

FIG. 4 shows a digital video system to which the 
image data illegal use prevention system of FlG. 1 is 
applied. Referring to FIG. 4, in the digital video system 
s shown, the image production and recording apparatus 
100 shown in FIG. 1 is formed as a video camera 100A 
and the image duplication apparatus 101 is formed as a 
video recorder 101A. 

In the video camera 100 A. an image imaged by an 
to imaging section 11 is sent as digital image data to a 
watermark data embedding section 12. Meanwhile, 
electronic watermark data to be embedded into digital 
image data are stored in a watermark data table 13. 
Thus, the electronic watermark data are read cut from 
is the watermark data table 1 3 and sent to the electronic 
watermark data embedding section 12. The watermark 
data embedding section 12 inserts the electronic water- 
mark data into the digital image data sent thereto in 
such a manner as described above. The digital image 
20 data in which the electronic watermark data are inserted 
are stored onto a recording medium 15 such as a mag* 
netic tape or an optical disk by a recording section 1 4. 

When a delicate is to be produced, the digital 
image data stored on the recording medium 15 are 
25 reproduced by a reproduction section 16 of the video 
recorder 101A Normally, the digital image data are 
stored onto a recording medium 19 again by a recording 
section 1 7 to produce a duplicate. However, if electronic 
watermark data are inserted in the digital image data 
so reproduced by the reproduction section 16, that is. if 
electronic watermark data are detected by a watermark 
data detection section 18. then such detection is 
reported to the recording section 17. When the detec- 
tion of electronic watermark data is reported, the 
35 recording section 17 doss not perform storage of the 
digital image data onto the recording medium 1S, 
thereby preventing BlegaJ duplication. 

Alternatively; when electronic watermark data are 
detected, dummy data may be supplied to the recording 
40 section 17 or data obtained by multiplying the water- 
mark data stored in the watermark data detection sec- 
tion 18 by a constant so that the data may have a 
maximum magnitude substantially equivalent to the 
dynamic range of the image data may be added to 
45 reproduced image data and sent to the recording sec- 
tion 1 7. If such data are supplied to the recording sec- 
tion 17, then an image quite different from the original 
image is outputted from the recording section 17, and 
consequently, ilegal duplication can be prevented even 
50 if a duplication operation is not inhibited. 

FIG. 5 shows a digital copying system to which the 
image data illegal use prevention system shown in FIG. 
1 is applied. Referring to FIG. 5, in the digital copying 
system shown, the image production and recording 
55 apparatus 100 shown in FIG. 1 is termed as a first cop- 
ying machine 1008 and the image duplication appara- 
tus 101 is termed as a second copying machine 101B. 
An original image 20 fetched by a scanning section 
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21 of the first copying machine 100B is sent as digital 
image data to a watermark data embedding section 22. 
Meanwhile, electronic watermark data to be embedded 
into digital image data are stored in a watermark data 
table 23. and they are read out from the watermark data 
table 23 and sent to the watermark data embedding 
section 22. The watermark data embedding section 22 
inserts the electronic watermark data into the tfgital 
image data sent thereto. The digital image data in which 
the electronic watermark data are inserted are printed 
on copy paper 25 by a printing section 24. 

In the second copying machine 101B. the image 
printed on the copy paper 25 is fetched and converted 
back into digital image data by a seaming section 26. 
Normally, the digital image data are printed on copy 
paper 29 again by a printing section 27 to produce a 
duplicate. However, if electronic watermark data are 
inserted in the digrtal inage data fetched by the scan- 
ning section 26, that ia, if electronic watermark data are 
detected by a watermark data detection section 28, then 
such detection Is reported to the printing section 27. 
The printing section 27 does not perform, when the 
detection of electronic watermark data is reported, 
printing of the digital Image data onto the copy paper 29, 
thereby preventing illegal copying. 

Alternatively, when the electronic watermark data 
are detected, dummy data may be supplied to the print- 
ing section 27 or data obtained by multiplying the water* 
mark data stored in the watermark data detection 
section 28 by a constant so that they may have a maxi- 
mum magnitude substantially equal to the dynamic 
range of the image data may be added to (stperposed 
on) the reproduced Image data and sent to the printing 
section 27. If such data are supplied to the printing sec- 
tion, then an image quite different from the original 
image is outputted from the printing section 27, Conse- 
quently, illegal copying can be prevented even H a copy- 
ing operation is not inhibited. 

FIG, 6 shows a printer system which makes use of 
a personal computer. Referring to FIQ. 6, the printer 
system 100C shown operates as the image production 
and recording apparatus 100 descrtoed hereinabove 
with reference to FIG. 1. In the printer system 100C. 
electronic watermark data to be embedded into digital 
image data are stored in a watermark data table 33. A 
watermark data embedding section 32 inserts the elec- 
tronic watermark data from the watermark data table 33 
into digital image data sent thereto from a personal 
computer 31 and sends resulting data to a printing sec- 
tion 34. The printing section 34 prints the digital image 
data, in which the electronic watermark data are 
inserted, on print paper 35. Consequently, even if it is 
tried to duplicate the digital image data using, for exam- 
ple, the copying machine 101B of FIG. 5, since the elec- 
tronic watermark data are detected by the watermark 
data detection section 28, illegal copying can be pre- 
vented. 

FIG. 7 shows a facsimile system. Referring to FIG. 


7 ( the facsimile system 101C shown operates as the the 
Image duplication apparatus 101 described herein* 
above with reference to FIG. 1 . In the facsimile system 
101C, when image data transmitted through a tele- 
5 phone line are received by a modem 41 , the image data 
are normally sent to a printing section 42, by which they 
are printed on facsimile paper 44. Where the received 
image data are digital image representing an image in 
which electronic watermark data are inserted like an 
to image printed, tor example, by the printer system 100C 
of FIG. 6, it is checked by a watermark data detection 
section 43 whether or not electronic watermark data are 
inserted In the digitaJ image data. If electronic water- 
mark data are detected then such detection is reported 
is to the printing section 42. When the detection of elec- 
tronic watermark data is reported, the printing section 
42 does not perform a printing operation, thereby pre- 
venting illegal duplication. 

Alternatively, if electronic watermark data are 
so detected, then dummy data may be supplied to the 
printing section 42 or data obtained by multiplying the 
watermark data stored in the watermark data detection 
section 43 by a constant so that they may have a maxi- 
mum magnitude substantially equal to the dynamic 
2S range of the image data may be added to (superposed 
on) the restored image data and sent to the printing sec- 
tion 42. If such data are received by the printing section 
42, then an image quite different from the original image 
ts outputted from the printing section 42. Consequently, 
30 illegal printing can be prevented even if a printing oper- 
ation is not inhibited. 

FIG. 8 shows a capture board system. Referring to 
FIG. 8, the capture board system 101 D shown operates 
as the the image duplication apparatus 101 described 
3S hereinabove with reference to FIG. 1. In the capture 
board system ioiD. image data fetched by image data 
fetching unit 51 are normally sent to a capture appara- 
tus 52, by which they are stored into an external storage 
apparatus 54. If the image data are digital image data in 
40 which electronic watermark data are Inserted like an 
image stored, tor example, by the video camera 100A of 
FIG. 4, then it is checked by an electronic watermark 
data detection apparatus 53 whether or not electronic 
watermark data are inserted in the digital image data. If 
45 electronic watermark data are detected, then such 
detection is reported to the capture apparatus 52. The 
capture apparatus 52 does not perform, when such 
detection of electronic watermark data is reported, a 
staring operation of data, thereby preventing illegal 
so duplication. 

Alternatively, if electronic watermark data are 
detected, then data may be supplied to the cap- 
ture apparatus 52 or data obtained by multiplying the 
watermark data stored in the watermark data detection 
SS apparatus 53 by a constant so that they may hove a 

maximum magnitude substantially equal to the dynamic 
range of the image data may be added to (superposed 
on) the restored image data and sent to the capture 
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apparatus 52. If such (tela are received by the capture 
apparatus, then an imaoe quite different from the origi- 
nal image is outputted from the capture apparatus 52. 
Consequently, illegal storage can be prevented even if a 
storing operation is not inhibited. 

FIG. 9 shows a data transfer system to which an 
image data Illegal use prevention system according to 
the present invention is applied. In the data transfer sys- 
tem, data are transferred from a storage unit of a trans- 
fer source to a storage unit of a transfer destination so 
that they may be copied. Referring to FIG. 9, an cnput- 
ting unit 61 checks whether or not there is a command 
inputted thereto. If an Inputted command is present 
then it is analyzed by a copy command analysis unit 62 
what the inputted command is. If it is discriminated, as a 
result of the analyeis. that the inputted command is a 
command to copy transfer source data 69 of a storage 
medium 66 of a transfer source to a transfer destination 
data area 70 of a storage medium 67 of a transfer des- 
ignation, then a command is sent to a copying process- 
ing execution unit 63 so that copying processing may be 
executed. The copying processing execution unit 63 
transfers the transfer source data 69 stored in the stor- 
age medium 66 of the transfer destination to temporary 
storage unit 65 and then causes the thus transferred 
data 69 to be checked by a waterma/fc data detec- 
tion/embedding unit 64. The watermark data detec- 
tion/embedding unit 64 detects presence or absence of 
watermark data in the data 69 and discriminates, if 
watermark data are detected, which one of permission 
and inhibition of copying the watermark data indicate. 

If a result of detection of watvmark data indicates 
permission of copying, then the transfer source data 69 
stored in the temporary storage unit 65 are copied into 
the transfer destination data area 70 of the storage 
medium 67, However, If the detected watermark data 
indicates permission of copying by m times, than 
dequantized data in which new watermark data are 
embedded are sent from the watermark data detec- 
tion/embedding unit 64 to the copying processing exe- 
cution unit 63 and stored into the transfer destination 
data area 70 of the storage medium 67 of the transfer 
destination, and copying is executed. Then, information 
representing what coping has been performed by the 
copying processing execution unit 63 is sent to and dis* 
played by display unit 68, thereby ending the copying 
processing. If the delected watermark data indicate 
inhibition of copying, then no copying is performed. 

Subsequently, operation of copying processing by 
the data transfer system of FIG. 9 is described with ref- 
erence to a flow chart of FIG. 10. 

The copying processing execution unit 63 reads out 
the transfer source data 69 from the storage medium 66 
of the transfer source in step Ai . In step A2, the transfer 
source data 69 are Inputted to the copy command anal- 
ysis unit 62, by which a header of MPEG data is ana- 
lyzed to discriminate whether or not the data are MPEG 
image data. 


If the transfer source data 69 are MPEG image 
data, then variable length decoding processing for 
dequantized data is performed in step A3, and the vari- 
able length coded data are dequantized in step A4. The 
5 dequantized data are supplied to the watermark data 
detection/embedding unit 64, by which watermark data 
are detected. In step A6. discrimination of the detected 
watermark data is performed. 

ff the watermark data detected in step AS indicate 
to Inhibition of copying, then the control jumps without 
doing anything to step A13. in which the processing is 
ended. 

If the watermark data detected in step A5 indicate 
that there is no limitation to the number of times in cop- 
's ying. the control jumps to step AI 2, in which the transfer 
source data 69 are copied Into the transfer destination 
data area 70, whereafter the control jumps to step A13, 
in which the processing is ended. 

If the watermark data detected in step A5 indicate 
20 permission of copying by m (m = 1 to k) times, m is 
updated to m a m-1 in step A7. Then, in step A8, water- 
mark data indicating permission of copying by m times 
are embedded into the data dequantized in step A4. 
Then, if m * 0 in step A9, then the data into which 
25 the watermark data indicating permission of copying by 
m times have been embedded in step A8 are quantized 
in step A10. The quantized data are variable length 
coded in step A1 1. The data variable length coded and 
converted into MPEG image data are inputted in step 
30 A12 to the copying processing execution unit 63. by 
which copying processing of them is performed. 

If m < 0 in step A9, then since this signifies that cop- 
ying is inhibited, the processing is ended. 

Subsequently, an exemplary construction of the 
35 watermark data detection/embedding unit 64 is 
described with reference to FIG. 11. The watermark 
data detection/embedding unit 64 is formed from an 
electronic watermark data embedding section 64A and 
an electronic watermark data detection section 64B. 
40 electronic watermark data detection section 

64B has a construction same as that of the watermark 
data detection unit 8 shown in FIG. 3, and the MPEG 
data F(i) decoded in step A3 of FIG. 10 are supplied to 
the partial average calculation section 1 11 and the mul- 
45 tiplier 1 12. The partial average calculation section 1 1 1 
calculates partial averages avg(F(i)) mentioned herein- 
above. The divider 116 performs calculation of 
W(i)«F(i)/avg(F(i)). 

Then, the adder 117 calculates, for the individual i 
so sum totals WF(i) of the calculated values W(i) for one 
image. Then, the sum totals WF(i) are supplied to the 
inner product calculation section 1 18, by which inner 
product calculation with the watermark data w(i) is per- 
formed. 

55 The inner product calculation section 118 calcu- 
lates inner products C for all of possible watermark data 
and supplies the thus calculated inner products C to the 
Similarity discrimination section 119. 
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The similarity discrimination section .119 detects 
that watermark data wtth which the inner prodbct C 
exhibits a maximum value, and sends out a result of the 
detection to the copying processing execution unit 63 of 

FIG. 9. 5 

The electronic watermark data embedcfing section 
64A has a construction same as that of the watermark 
data embedding unit 2 shown in FIG. 2. and the transfer 
source data from which the original watermark data 
have been removed in step AS of FIG. 10 are inputted to io 
the partial average calculation section 111 and the 
adder 114. 

The partial average calculation section m calcu- 
lates a partial average described hereinabove and sip- 
plies a result of the calculation to one of irput teminals is 
of the multiplier 112. 

To the other input terminal of the multiplier 112, the 
watermark data w{i) which indicate the value of m deter- 
mined in step A7 of FIG. 10 are supplied. An output of 
the multiplier 112 is multiplied by a scaling factor a by 20 
the multiplier 113, and a resiit of the multiplication is 
added to the digital Image data by the adder 114. A 
result of the addition, that is, image data 
(F(i) ♦ a • arg(f(i)) • w(i)) in which the new watermark 
data are embedded, are obtained from the adder 114 & 
and supplied to the copying processing execution unit 
63 of FIG. 9. 

Having now fully described the invention, rt w»be 
apparent to one of ordinary skHI in the art that many 
changes and modifications can be made thereto without $0 
departing from the spirit and scope of the invention as 
set forth herein. 


4. 


Claims 

1 . An image data illegal use prevention system, char- 
acterized in that it conrprieee: 

image data fetching means (6; 16; 26; 41; 51) 
for fetching digital image data in which elec- 
tronic watermark data may be embedded; 
electronic watermark data detection means (8; 
16; 26; 43; 53) for detecting electronic water- 
mark data from the Image data fetched by said 
image data fetching means (6; 16; 26: 41: 51); 
and 

transfer inhibition means (7; 17; 27; 42; 52) tor 
inhibiting, if electronic watermark data are 
detected by said electronic watermark data 
detection means (8; 18; 28; 43: S3), transfer of 
the image data fetched by said irmge data 
fetching means (1 ; 1 1 ; 21 . 31 ; 61 ) to a transfer 
destination (9; 19; 29; 44; 54). 


35 


45 


so 6. 


An image data illegal use prevention system, char- ss 
acterized in that it comprises; 

Image data fetching means (6; 16; 26; 41; 51) 


for fetching digital image data in which elec- 
tronic watermark data may be embedded: 
electronic watermark data detection means (8; 
18: 28: 43: 53) tor detecting electronic water- 
mark data from the image data fetched by said 
image data fetching means (6; 16: 26; 41 ; 51); 
and 

transfer means (7; 17; 27; 42; 52) for transfer- 
ring, if electronic water mark data are detected 
by said electronic watermark data detection 
means (8; 18; 28; 43; 53). data different from 
the image data fetched by said image data 
fetching means (1; 1 1 ; 21 ; 31 ; 61) to a transfer 
destination (9; 19; 29; 44; 54). 

An image data illegal use inhibition system as set 
forth in claim 2, characterized in that the different 
data are data obtained by superposing data 
obtained by multiplying the electronic watermark 
data by a constant on the image data fetched by 
said image data fetching means (6; 1 6; 26; 41 ; 51). 

An image data illegal use prevention system, char- 
acterized in that it comprises: 

image data fetching means (66) for fetching 
digital image data in which electronic water- 
mark data may be embedded: 
electronic watermark data detection means 
(64) for detecting the electronic watermark data 
from the image data fetched by said image data 
fetching means (66): and 
transfer inhfoition means (63) for discriminating 
whether the detected electronic watermark 
data indicate transfer permission or inhibition 
and inhibiting, when the detected electronic 
water mark data indicate transfer inhibition, a 
transferring operation of the fetched image 
data to a transfer destination (67). 

An image data illegal use inhibition system as set 
forth in daim 4. characterized in that said transfer 
inhibition means (63) discriminates, when the 
detected electronic watermark data include a value 
representing that the transfer permission time 
number is zero, that the detected electronic water* 
mark data are electronic watermark data indicating 
transfer inhibition. 

An image data iflegal use inhibition system, charac- 
terized in that it comprises: 

image data fetching meanG (66) for fetching 
digital image data in which electronic water* 
mark data including a value indieatipQjhat the 
transfer permission time nurrtber is m may be 
embedded; 

watermark data embedding means (64) for 
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embedding, into the fetched image data, new 
electronic watermark data which includes a 
value indicating that the transfer permission 
time number Is smaller by one than the preced- 
ing value of m; and 

transfer meane (68) for transferring the image 
data in which the new electronic watermark 
data are entoedded to a transfer destination 

(67). 

10 

7. An image data legal use inhibition system as set 
forth in any one of claims 1 to 6. characterized in 
that the electronic watermark data are calctieted in 
accordance wKh a predetermined expression using 
frequency components of the digital image data ts 
obtained by discrete cosine transform. 

8. An image data Uegal use inhibition system as set 
forth in any one of claims i to 7, characterized in 
that said image data fetching means (6; 16; 26; 41 ; 20 
51 ; 66) fetches tfgttal image data from a recording 
medium (5; 15; 25; 35; 69) on which the digital 
image data are recorded, and the transfer destina- 
tion is a recording medium (9; 19; 29; 44; 54, 70) 
different from the recording medium (5; 15; 25; 35; 25 
69) on which the rtg'rtaf image data are recorded. 


so 
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